Noname manuscript No. 

(will be inserted by the editor) 



A decaying factor accounts for contained activity in 
neuronal networks with no need of hierarchical or 
modular organization 

Diego Raphael Amancio • Osvaldo Novais 
Oliveira Jr. • Luciano da Fontoura Costa 



Received: date / Accepted: date 



Abstract The mechanisms responsible for contention of activity in systems 
represented by networks are crucial in various phenomena, as in diseases such 
as epilepsy that affects the neuronal networks, and for information dissemi- 
nation in social networks. The first models to account for contained activity 
included triggering and inhibition processes, but they cannot be applied to 
social networks where inhibition is clearly absent. A recent model showed that 
contained activity can be achieved with no need of inhibition processes pro- 
vided that the network is subdivided in modules (communities). In this paper, 
we introduce a new concept inspired in the Hebbian theory through which ac- 
tivity contention is reached by incorporating a dynamics based on a decaying 
activity in a random walk mechanism preferential to the node activity. Upon 
selecting the decay coefficient within a proper range, we observed sustained 
activity in all the networks tested, viz. random, Barabasi- Albert and geograph- 
ical networks. The generality of this finding was confirmed by showing that 
modularity is no longer needed if the dynamics based on the integrate-and-fire 
dynamics incorporated the decay factor. Taken together, these results provide 
a proof of principle that persistent, restrained network activation might occur 
in the absence of any particular topological structure. This may be the reason 
why neuronal activity does not outspread to the entire neuronal network, even 
when no special topological organization exists. 
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1 Introduction 

The human brain is an example of complex system 1,2,3, where the local 
dynamics is unable to predict the global functionality because the brain com- 
ponents relate to each other in a non-trivial way. This is why the brain has 
often been represented as complex networks [H[5] at various scales [6l[7] , rang- 
ing from neurons linked by synapses to interconnected large brain regions [HI 
[§]. With this type of representation, one may learn about brain functionality 
and operation. For example, the network framework allowed the observation 
of synchronization patterns and the establishment of conditions for epileptic 
seizures, in terms of the topological organization [7l fT0lfTT] . It has been sug- 
gested that the human brain works in a critical region analogous to a phase 
transition dynamics between ordered and chaotic behaviors |12j . This critical 
operation, characterized by a persistent dynamics where the activation nei- 
ther quickly dies out nor activates the whole network, is essential for studying 
functional patterns in complex neural networks 12,13 . Because the critical 
operation is responsible for the maintenance of brain functions [12] (e.g., in 
the critical operation processing capabilities are enhanced [THUS] and epilep- 
tic seizures are prevented [13] , it is crucial to determine the factors leading to 
such restrictions of activity. 

While traditional neural networks models require excitatory and inhibitory 
connections to restrain activity in the critical operation [TBlfTT] , recent models 
have shown it to be possible to restrain activity without inhibitory connec- 
tions [T2lll3j . More specifically, with nodes representing cortical columns [H] 
rather than individual neurons, a simple dynamics could explain restrained ac- 
tivity in hierarchical modular neural networks I!) 20.21 under a wide range 
of initial parameters jl3j . In this paper, we introduce a dynamics that gener- 
alizes the approach reported in Ref. [13] . Taking as inspiration the Hebbian 
theory, according to which neuronal links are reinforced whenever they are 
stimulated, we adopted a random walk dynamics preferential to the node ac- 
tivity. We show that the neuronal activity can be topologically constrained 
even in non-modular structures such as random, geographical and scale-free 
networks. Therefore, the existence of hierarchy and communities is no longer 
required. In addition, differently from the model in Ref. |13j . the number of 
active nodes in the steady state is weakly dependent on the initial localization 
of the random walker. 



2 Description of the Preferential Random Walk 

Random walks have been employed in a wide variety of contexts 22, 2311241 
1251126] . including brain networks as a complementary strategy to the analysis 
of synchronization properties provided by spectral analysis [2"7II25ll2l?] . Tradi- 
tional random walks were used to analyze the interplay between structure and 
function in cortical and neural networks [231130] . while self-avoiding random 
walks [31] were employed to show that the human cortical network is most 
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resilient to brain injuries pQ. The proposed model of preferential random walk 
is based on the Hebbian theory [35], which imposes a rule to determine how 
the weights connecting neurons in neural networks are updated. Formally, the 
weight Wij linking neurons i and j is updated according to: 

p 

where x\ is the fc-th input for neuron i and p is the number of training patterns 
in the artificial neural network |39j . Thus, neurons that are repeatedly fired 
at the same time will tend to have their links strengthened. This effect is 
simulated through the introduction of a preferential random walk where the 
particle performing the random walk is more likely to leap onto a node that 
has already been frequently accessed in the last iterations. Thus, analogously 
to the Hebbian theory for edges weights, nodes frequently accessed will tend to 
increase its activity due to the reinforcement effect. The proposed random walk 
is preferential to the activity T of each node at the time step t. At t = to = 1, 
every node i has activity 7$ = f . Assuming that the particle performing the 
random walk over the network is at node i, having j as its neighbor, the next 
node to be visited at t + 1 is chosen according to the probability P^l '■ 

i 



where 



V 

p*+i = 'j ; (2) 

1 ^2k a ikT k 



. 1 if z and k are connected, , . 

aik = i otherwise. ^ ' 



In other words, the particle tends to propagate toward the most active neigh- 
bor. The next node visited will have its activity increased by one unity. At the 
beginning of every time step t, all nodes have their activity decaying according 
to the following rule: 

V +1 = *V, (4) 

where a is the rate of activity preservation, which is restricted to the interval 
< a < 1. In the experiments, a given node i was considered activated when 
Ti > t c . Arbitrarily, we adopted r c = 2.5. 



Results and Discussion 

Sustained activity was observed with the preferential random walk process 
provided that the preservation coefficient a (equation [4]) was a < 0.9999. 
Figure [T] shows that after an abrupt onset of activity in the first few time 
steps, a sharp decrease occurs for all three networks leading eventually to only 
a single active connected component The sharpest decay occurred for the 



1 A component is a subnetwok in which there is a path between all nodes belonging to 
the component. 
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Fig. 1 Number of components of activated nodes when t > tt for the (a) random network, 
built from the Erdos-Renyi model 32 ; (b) geographical network, built from a Voronoi dia- 
gram |5ll33| : and (c) scale- free (BA) network, obtained from the Barabasi-Albert model |34l 
135 1 (see degree distributions in Figure SI of the Supplementary Information). The average 
degree (k) and the number of nodes TV were fixed in (fc) = 3 and TV = 3000. All results 
were obtained by performing 50 simulations. The dynamics was applied for the three net- 
works and the initial node was randomly chosen in each one of the executions. Note that, 
for the three networks, the dynamics converges to a single component, which characterizes 
a sustained activation. 



geographical network, since at t = 4.0 x 10 4 activity was restrained to only one 
component. The activation in geographic networks probably stabilizes faster 
because these networks are devoid of long-range connections. As such, the 
activation does not spread to other regions of the network. 

Similar results were obtained for the number of active nodes (Figure S2 
of the SI), since after 2.0 x 10 5 steps activity decayed to a small number of 
nodes for the 3 networks. Here, however, important differences were noted in 
comparing the networks. The maximum number of activated nodes was ca. 7% 
for the random and BA networks, but for the geographical network this was 
ca. 1%. This difference may be ascribed to the small- world property inherent 
in both BA and random networks. As one should expect, the number of active 
nodes increases with the preservation factor a, as shown in Figure S3 of the 
SI. 

Further analysis can be made by considering which nodes remain active 
throughout the simulations. Figure [2] shows the evolution of activated nodes 
in a small geographical network in a given execution of the model (a similar 
evolution was observed for the other network models). It is worth noting that 
even when the random walk starts from the same initial node, the set of active 
nodes at t = tf is not always the same. Actually, most of the times the final 
activation is spread along the nearest neighbors from the starting node, as 
illustrated in Figure [3] (see also Figure S4 of the SI) . The amount of active 
nodes appears to be independent of the starting node for the random walk, 
as very little impact was observed on the spreading (see Figure S5 of the SI). 
This is in contrast with the results in Ref. [13] . 

The set of active nodes was largely preserved throughout the time evo- 
lution for the random and the geographical networks, as shown in Figure 2] 
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Fig. 2 Visualization of activity spreading in a small geographical network with N = 300 
and (k) = 3. The colors represent the different scales of activity T: blue, for 1.0 < T < 1.5; 
yellow, for 1.5 < T < 2.0; orange, for 2.0 < T < 2.5 and red, for T > 2.5. Note that in the 
first steps the activation spreads quickly. Then, the set of active nodes becomes increasingly 
smaller until reaching the steady configuration at t = tr = 200, 000. 





Fig. 3 Geographical network and the frequency of activation in 300 executions. The diam- 
eter of nodes is proportional to the number of times that a given node was active at t = 1 1 . 
All the preferential random walks started at the red node. 
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Fig. 4 Preservation rate r of the set of active nodes, r is defined as r = \St„ <~\St a +A \/\St„ |, 
where St a represents the set of active nodes at t = t and S to +A represents the set of active 
vertices at t = t + A. In this figure, A = 1,000. After the first steps, there is almost no 
variation in the set of active nodes for both random and geographical networks. This means 
that the set of active nodes remains static. In the case of scale-free network a very different 
behavior emerged. In the early stages there is a slight variation whereas in the subsequent 
steps about 83 % of the set of active nodes vary within A = 1,000 steps. 




Fig. 5 Evolution of the modularity Q for (a) the random network; (b) the geographical 
network; and (c) the scale-free network. Q is given by Q = (l/4m) . . (cii, — kikj /2m)(l — 

SiSj), where ciij is an element of the adjacency matrix, ki = Jj. ciij is the degree of node 
i and Si = 1 if i is an active node and Si = otherwise. While the modularity of the 
geographical network remains nearly constant, it decreases at the first steps and remains 
constant for both random and scale-free networks. 



In contrast, only 83% of the active nodes preserved their activity for the BA 
network, probably because activity was directed toward the hubs. 

An important difference was observed with regard to the results reported 
by [IS]. Rather than being organized in communities 2D] (i-e., in groups of 
nodes strongly connected to each other and weakly connected to nodes of other 
groups), the active nodes were not restrained to communities, as indicated by 
the degree of modularity Q in Figure [S] (the higher the value of Q, the greater 
the tendency to restrain activity in a community). The BA network again 
behaved differently. 

The importance of introducing a decay factor in the dynamics was verified 
by considering the widely used integrate-and-hre dynamics [36] . The latter can 
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Fig. 6 Dynamics of the set of activated nodes (i.e., nodes with Tj > r c ) in the random 
network when (a) a = 0.9000, (b) a = 0.9020 and a = 0.9022. While in (a) in (b) the 
activity is restrained, in (c) it spreads all over the network. 



be described mathematically using: 

Tt+ i _ f n + 7 Ef=i E f mc* - 1*) if n < ^ ^ 

E, | L. J " 'J rt T i> T f 

where T\ represents the accumulated potential of node i at time t, tj is the 
time when the /-th spike occurs and 7 is the coupling factor. When the poten- 
tial Ti reaches a given threshold Tf , the node sends the accumulated activation 
throughout the outcome links and its internal state is cleaned. In the simu- 
lations we considered 7 = 1 and 77 = 3. The effect of decay was taken into 
account simply by multiplying the current potential T\ by a. 

Figure [5] confirms that activity is sustained for the random network, pro- 
vided a proper value for the rate of activity preservation is used. Interestingly, 
the same conclusion was found for the other two network models (see Figures 
S6 and S7 of the SI). Therefore, the observation of contained activity for mod- 
ular networks reported by [13] no longer applies when the proposed dynamics 
is adopted. 



3 Conclusion 



The study of the brain with the representation provided by the network frame- 
work is one of the most promising issues in neuroscience. In the current paper 
we have employed complex networks to study the conditions influencing the 
operation in the critical point. Upon introducing a novel random walk pref- 
erential to the activity of nodes (i.e., preferential to the recent frequency of 
access) inspired in the biological model of Hebb [38], we found as a proof of 
principle that persistent and contained network activation can occur not only 
in the absence of inhibitory nodes, but also in the absence of a hierarchical 
clustered organization. In particular, this result can be seen as a generalization 
of previous findings with similar dynamics [13] advocating that small-worlds 
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and random networks could not restrict the activity without the presence of 
inhibitory connections. The detailed analysis of the proposed preferential ran- 
dom walk revealed different behaviors for the three networks studied. While 
the number of active nodes at the steady state is similar both in random and 
scale-free networks, this quantity is much smaller in geographic networks. This 
result suggests that the spread is facilitated by the long-range connections and 
the small- world effect present in such networks. At the steady state, the size of 
the active set was found to be similar for all three networks. The dependence 
of the size of this active core on the activity decay was also verified. In all 
cases, the number of active nodes increases with the preservation factor. We 
also found that during the first time steps of the spreading, the active nodes 
move toward the formation of an anti-community structure £3? , in opposition 
to the behavior observed in other similar dynamics. Finally, we have investi- 
gated the influence of the choice of the initial node on some dynamical aspects. 
More specifically, we found that there is no apparent relationship between the 
degree of the node locating the random walker at t = to and the size of the 
active core at the steady state. On the other hand, we verified that the choice 
of the initial node interferes with the localization of the active nodes at t = tf, 
for the final set of actives nodes spreads along the nearest neighbors from the 
initial activation. 

As future work, the approach may be extended by considering other phe- 
nomena along the dynamics. For example, one could examine if a limited 
sustained activity is kept when the exhaustion phenomena |13) is taken into 
account, as some neurological systems do not maintain activation for long pe- 
riods in order to save brain resources. Also, one could probe the effect from 
different types of network connectivity on the spreading of activation, as dis- 
eases such as epilepsy might be related to distinct connectivity patterns. 
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Figure SI Degree distribution for the (a) random network; (b) geographical network; and 
(c) scale-free network. 




Figure S2 Number of activated nodes when t > tf for the (a) random network; (b) 
geographical network; and (c) scale-free network. In all networks, the dynamics converges 
to a steady set of activated nodes. 
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Figure S3 Relationship between the rate of activity decay and the number of activated 
nodes for (a) the random network; (b) the geographical networks; and for (c) scale-free 
network. The sole parameter present in the dynamics of the preferential random walk is 
a, which models the rate of activity preservation. More specifically, while large values of a 
leads to a slow activity decrease, low values of a yields a more pronounced activity decrease. 
The size of the set of active nodes was computed varying a within the range 0.99990 < a < 
0.99995. In all networks, an increasing trend with a could be observed. Specially, a strong 
correlation occurred for both scale-free and geographical networks. Therefore, the fraction 
of active nodes can be straightforwardly adjusted by setting the value of the parameter a. 
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Figure S4 Distance between the node starting the preferential random walk and the set of 
active active nodes at t = tf , for (a) the random network; (b) the geographical network; and 
(c) the scale-free network. In all cases, the activation spreads along the nearest neighbors. 
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Figure S5 Size of the set of activated nodes and its relationship with the degree of nodes 
starting the preferential random walk for (a) the random network; (b) the geographical net- 
works; and for (c) scale-free network. In all cases, localization had weak impact on spread- 
ing. The influence of initial position of the particle was verified by starting the random 
walk in nodes with distinct degree. Then, the number of activated nodes at t > tf was 
computed for each class of starting nodes. Given the degree distributions in Figure IS 1 1 
the set of degrees selected to start the walk was: D r = {1,2,3,4,5,6,7,8,9,10,11,12}, 
D g = {2,3,4,5,6,7,8,9,10} and D s = {3,5,7,9,11,13,15,17,19,21} respectively for the 
random, geographical and scale-free networks. For the three network models, weak impact 
on spreading in the was observed. Interestingly, this result differs from the results reported 
in Ref. 13 , which showed that a similar dynamics of activated nodes depends on where the 
initial activation was localized, especially for hierarchical modular networks. 




Figure S6 Dynamics of the set of activated nodes (i.e., nodes with T; > t c ) submitted 
to the Integrate-and-Fire dynamics for the geographical network when (a) a = 0.8050, (b) 
a = 0.8100 and a = 0.81125. While in (a) in (b) the activity is restrained, in (c) it spreads 
all over the network. 
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Figure S7 Dynamics of the set of activated nodes (i.e., nodes with Tj > t c ) submitted to 
the Integrate-and-Fire dynamics for the BA network when (a) a = 0.7440, (b) a = 0.7480 
and a = 0.7452. While in (a) in (b) the activity is restrained, in (c) it spreads all over the 
network. 



